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Foreword 


ISO (the International Organization for Standardization) is ‘a worldwide 
federation of national standards bodies (ISO member bodies).-The work 
of preparing International Standards is normally carried out through !SO, 
technical committees. Each member body interested in. a subject-for - 
which a technical committee has been established has the right to be 
represented on that committee. International organizations, governmental 
and non-governmental, in liaison with ISO, also take part in the work, ISO i 
collaborates closely with the International Electrotechnical Commission 
(IEC) on all matters of electrotechnical standardization. 


Draft International Standards adopted by the technical committees are: 
circulated to. the member bodies for voting. Publication as an International 
Standard requires approval by at least 75 % of the member bodies casting 
a vote. 


International Standard 1SO 5725-3 was prepared by Technical Committee 
ISO/TC 69, Applications of statistical methods, Subcommittee SC 6, 
Measurement methods and results. 


ISO 5725 consists of the following parts, under the general title Accuracy 
(trueness and precision) of measurement methods and results: : 


— Part 1: General principles and definitions 


— Part 2: Basic method for the determination of repeatability and 
reproducibility of a standard measurement method 


— Part 3: Intermediate measures of the precision of a standard 
measurement method 


— Part 4: Basic methods for the determination of the trueness of a 
standard measurement method 


— Part 5: Alternative methods for the determination of the precision 
of a standard measurement method 


— Part 6: Use in practice of accuracy values 


Parts 1 to 6 of ISO 5725 together cance! and replace ISO 5725:1986, 
which has been extended to cover trueness (in addition to precision) and 
intermediate precision conditions {in addition to repeatability conditions 
and reproducibility Conditions). : 
Annexes A, B and C form an integral part of this part of ISO 5725. Annexes 
D and E are for information only. 


Introduction 


0.1 !SO 5725 uses two terms “trueness” and “precision” to describe} 
the accuracy of a measurement method. “Trueness” réfers to the close-.; 
ness of agreement between the average value of a large number of test E 


results and the true or accepted reference value. “Precision” refers to the | 
closeness of agreement between test results. a 


i 
0.2 General consideration of these quantities is given in 1SO.5725-1 and : 
so is not repeated here. It is stressed that ISO 5725-1 should be read in? 
conjunction with all other parts of ISO 5725 because the underlying defi 
nitions and general principles are given there. 3 


0.3 Many different factors (apart from variations between supposedly 
identical specimens) may contribute to the varia ility of results from a 
measurement method, including: 


a) the operator; 

b) the equipment used; 

c) the calibration of the equipment; 

d) the environment (temperature, humidity, air pollution, etc.); 
e) the batch of a reagent; 


f) the time elapsed between measurements. 


The variability between measurements performed by different operators 
and/or with different equipment will usually be greater than the variability 
between measurements carried out within a short interval of time by a 
single operator using the same equipment 


0.4 Two conditions of precision, termed repeatability and reproducibility 
conditions, have been found necessary and, for many practical cases, 
useful for describing the variability of a measurement method. Under re- 
peatability conditions, factors a) to f) in 0.3 are considered constants and 
do not contribute to the variability, while under reproducibility conditions 
they vary and do contribute to the variability of the test results Thus re- 
Peatability and reproducibility. conditions are the two extremes of pre- 
cision, the first describing the minimum and the second the maximum 
variability in results. Intermediate conditions between these two extreme 
conditions of precision afé also conceivable, when one or more ct factors 


1$0.5725-3: 


Accuracy (trueness and precision) of measurement 


methods and results — 


Part 3: 


Intermediate measures of the precision of a standard 


measurement method 


1, Scope 


1.1 This part of ISO 5725 specifies four intermedi- 
ate precision measures due to changes in observation 
conditions (time, calibration; operator and equipment) 
within a laboratory. These intermediate measures can 
be established by an experiment within a specific 
laboratory or by an interlaboratory experiment. 


Furthermore, this part of ISO 5725 


a) discusses the implications of the definitions of in- 
termediate precision measures; 


b) presents guidance on the interpretation and appli- 
cation of the estimates of intermediate precision 
measures in practical situations; 


c) does not provide any measure of the errors in 
estimating intermediate precision measures; 


d) does not concern itself with determining the 
trueness of the measurement method itself, but 
does discuss the connections between trueness 
and measurement conditions. 


1.2 This part of ISO 5725 is concerned exciuswely 
with méasurement methods which yield measure- 
ments on a continuous scale and give a single value 
as the test result, although the single value may be 


the outcome of a calculation from a set of obser- 
vations. 


1.3. The essence of the determination of these in- 
termediate precision measures is that they measure 
the ability of the measurement method to repeat test 
results under the defined conditions. 


1.4 The statistical methods developed in this part 
of ISO 5725 rely on the premise that one can pool 
information from “similar” measurement conditions 
to obtain more accurate information on the inter- 
mediate precision measures. This premise is a 
powerful one as long as what is claimed as “similar” 
is indeed “similar”. But it is very difficult for this 
premise to hold when intermediate precision meas- 
ures are estimated from an interlaboratory study. For 
example, controlling the effect of “time” or of “oper- 
ator” across laboratories in such a way that they are 
“similar”, so that pooling information from different 
laboratories makes sense, is very difficult. Thus, using 
results from interlaboratory studies on intermediate 
precision .measures requires caution. Within- 
laboratory studies also rely on this premise, but in 
such studies it is more likely to be realistic, because 
the control and knowledge of the actual effect of a 
factor is then more within reach of the analyst 


1.5 There exist-other techniques besides the ones 
described in this part.of ISO 5725 to estimate and to 
verify intermediate precision measures within a lab- 


fory, for example, control charts (see ISO 5725-6). 
This part of {SO 5725 does not claim to describe the 
“only approach to the estimation of intermediate pre- 
cision measures within a specific laboratory. 


NOTE 1 This part of ISO 5725 refers to designs of ex- 
periments such as nested designs. Some basic information 
is given in annexes B and C. Other references in this area 
are given in annex E. 


2 Normative references 


The following standards contain provisions which, 
through reference in this text, constitute provisions 
of this part of ISO 5725. At the time of publication, the 
editions indicated were valid. All standards are subject 
to revision, and parties to agreements based on this 
part of ISO 5725 are encouraged to investigate the 
possibility of applying the most recent editions of the 
standards indicated below. Members of IEC and ISO 
maintain registers of currently valid International 
Standards. 


ISO 3534-1:1993, Statistics — Vocabulary and sym- 
bols — Part 1: Probability and general statistical 
terms. 


ISO 5725-1:1994, Accuracy (trueness and precision) 
of measurement methods and results — Part 1: 
General principles and definitions. 


ISO 5725-2:1994, Accuracy (trueness and precision) 
of measurement methods and results — Part 2: Basic 
method for the determination of repeatability and 
reproducibility of a standard measurement method. 


ISO Guide 33:1989, Uses of certified reference ma- 
terials, 


ISO Guide 35:1989, Certification of reference ma- 
terials — General and statistical principles. 


“3 Definitions 


For the purposes of this. part of ISO 5725, the defi- 
nitions given in !SO 3534-1 and ISO 5725-1 apply. 


The symbols. used in ISO 5725 are given in annex A. 


4 General requirement 


In order that the measurements are made in the same 

. way, the measurement method shali have been 
standardized. All measurements forming part of an 
experiment within a specific laboratory or of an inter- 
laboratory experiment shall’ be carried out according 
to that standard. 


5 Important factors 


5.1 Four factors (time, calibration, operator and 
equipment) in the measurement conditions within a 
laboratory are considered to make the main contri- 
butions to ‘the variability of measurements (see 
table 1). 


5.2 “Measurements made at the same time” in- 
clude those conducted in as short a time as feasible 
in order to minimize changes in conditions, such as 
environmental conditions, which cannot always be 
guaranteed constant. “Measurements made at differ- 
ent times”, that is those carried out at long intervals 
of time, may include effects due to changes in en- 
vironmental conditions. 


Table 1 — Four important factors and their states 


Measurement conditions within a laboratory 


State 1 (same) 


Time 
time 
Calibration 
ments 


Operator Same operator 


Equipment 
9 bration 


Measurements made at the same 


No calibration between measure- 


Same equipment without recal- 


State 2 (different) 


Measurements made at different 
times 


Calibration carried out between 
measurements 


Different operators 


Different equipment 


5.3 Calibration” does not refer hereto any~cali- 
bration required as an integral part of obtaining a test 
result by the measurement method. It refers to the 
calibration process that takes place at regular intervals 
between groups of measurements within a labora- 


tory. 


5.4 In some operations, the “operator” may be, in 
fact, a team of operators, each of whom performs 
some specific part of the procedure. In such a case, 
the team should be regarded as the operator, and any 
change in membership or in the allotment of duties 
within the team should be regarded as providing a 
different “operator”. 


5.5 “Equipment” is often, in fact, sets of equip- 
ment, and any change in any significant component 
should be regarded as providing different equipment. 
As to what constitutes a significant component, 
common sense must prevail. A change of 
thermometer would be considered a significant com- 
ponent, but using a slightly different vessel to contain 
a water bath would be considered trivial. A change of 
a batch of a reagent should be considered a significant 
component. It can lead to different “equipment” or to 
a recalibration if such a change is followed by cali- 
bration. 


5.6 Under repeatability conditions, all four factors 
are at state1 of table1. For intermediate precision 
conditions, one or more factors are at state 2 of 
table1, and are specified as “precision conditions 
with M factor(s) different”, where M is the number 
of factors at state 2. Under reproducibility conditions, 
results are obtained by different laboratories, so that 
not only are all four factors at state 2 but also there 
are additional effects due to the differences between 
laboratories in management and maintenance of the 
laboratories, general training levels of operators, and 
in stability and checking of test results, etc 


5.7 Under intermediate precision conditions with M 
factor(s) different, it is necessary to specify which 
factors are at state 2 of table 1 by means of suffixes, 
for example: 


— time-different intermediate precisicn standard de- 
viation, Sic: 


— calibration-different intermediate orecsion stan- 
dard deviation, sc): 


~ —-operator-different intermediate precision standa; 


deviation, s\o): 


— [time + operator]}-different intermediate precisig; 
standard deviation, siqo); 


— [time + operator + equipment)-different inter: 
mediate precision standard deviation, s\o¢); 


— and many others in a similar fashion. 


6 Statistical model 


6.1 Basic model 


For estimating the accuracy (trueness and precision)}, 
of a measurement method, it is useful to assume that! 


every test result, y, is the sum of three components: | 
y=m+Bre .. Ae 


where, for the particular material tested, 


m_ is the general mean (expectation); 


B is the laboratory component of bias under re- 
peatability conditions; i 


e is the random error occurring in every: 
measurement under repeatability conditions. 


A discussion of each of these components, and of 
extensions of this basic model, follows. 


6.2 General mean, m 


6.2.1 The general mean, m, is the overall mean of 
the test results. The value of m obtained in a 
collaborative study (see ISO 5725-2) depends solely ' 
on the “true value” and the measurement method, |. 
and does not depend on the laboratory, equipment, 
operator or time by or at which any test result has 
been obtained. The general mean of the particular | 
material measured is called the “level of the test”; for 
example, specimens of different purities of a chemical 
or different materials (e.g. different types of steel) will 
correspond to different levels 


In many situations, the concept of a true value p holds 
good, such as the true concentration of a solution 
which is beingtitrated. The level m is not usually equal 
to the true value y; the difference (m — n) is called the 
“bias of the Measurement me:od’ 


In some situations, the level of the test is exclusively 
‘defined by the measurement method, and the con- 


“cept of an independent true value does not apply; for 


example, the Vicker's hardness of steel and the 
Micum indices of coke belong to this category. How- 
ever, in general, the bias is dénoted by 6 (6 = 0 where 
no true value exists), then the general mean m is 


m="+d agin 2) 


NOTE 2 Discussion of the bias term 6 and a description 
of trueness-experiments are given in ISO 5725-4. 


6.2.2 When examining the difference between test 
results obtained by the same measurement method, 
the bias of the measurement method may have no 
influence and can be ignored, unless it is a function 
of the level of the test. When comparing test results 
with a value specified in a contract, or a standard 
value where the contract or specification refers to the 
true value y and not to the level of the test m, or when 
comparing test ‘results - obtained using different 
measurement methods, the bias of the measurement 
method must be taken into account: 


63 TermB 


6.3.1 B is a term representing the deviation of a 
laboratory, for one or more reasons, from m, irre- 
spective of the random error e occurring in every test 
result. Under repeatability conditions in one labora- 
tory, B is considered constant and is called the “lab- 
oratory component of bias”. 


6.3.2 However, when using a measurement method 
routinely, it is apparent that embodied within an 
overall value for B are a large number of effects which 
are due, for example, to changes in the operator, the 
equipment used, the calibration of the equipment, and 
the énvironment (temperature, humidity, air pollution, 
etc.). The statistical mode! [equation (1)] can then be 
rewritten in the form: 


Y=m+ Bo+ By + Ba +--+ -+-@) 


or 
Y= H+ 6+ Bot+Byy t+ Bay t+--+€ ---(4) 


where B is composed of contributions from variates 
Bo, By), Big) ... and can account for a number of inter- 
mediate precision factors. 


In practice, the objectives of a study and consider- 


“ations of the sensitivity of the measurement method 


will govern the extent to which this model is used. In 
many cases, abbreviated forms will suffice. 


6.4 Terms By, Bi), By), etc. 


6.4.1 Under repeatability conditions, these terms all 
remain constant and add to the bias of the test re- 
sults. Under intermediate precision conditions, By is 
the fixed effect of the factor(s) that remained the 
same (state 1 of table), while By), Bi, etc. are the 
fandom effects of the factor(s) which vary (state 2 of 
table 1). These no longer contribute to the bias, but 
increase the intermediate. precision standard deviation 
so that it becomes larger. than the repeatability stan- 
dard.deviation. ., ; : 


6.4.2 The effects due to differences between oper-. 


” ators include personal ‘habits in operating measure- 


ment methods (e.g. in reading graduations on scales, 
etc.). Some of these differences should be removable 
by standardization of the measurement method, . par- 
ticularly in having a clear and accurate description of 
the techniques involved. Even though there is a bias 
in the test results obtained: by an individual operator; 
that bias is not always constant (e.g. the magnitude 
of the bias will change according to his/her mental 
and/or physical conditions on that day) and the bias 
cannot be corrected or calibrated exactly. The magni- 
tude of such a-bias should be reduced by use of a 
clear operation manual and training. Under such cir- 
cumstances, the effect of changing operators can be 
considered to be of a random nature. 


6.4.3 The effects due to differences between 
equipment include the effects due to different places 
of installation, particularly in fluctuations of the indi- 
cator, etc. Some of the effects due to differences 
between equipment can be corrected by exact cali- 
bration. Differences due to systematic causes be- 
tween equipment should be corrected by calibration, 
and such a procedure should be included in the stan- 
dard method. For example, a change in the batch of 
@ reagent could be treated that way. An accepted 
reference value is needed for this, for which 
'SO Guide 33 and. ISO Guide 35 shall be consulted 
The remaining effect due to equipment which has 
been calibrated using a reference material is con- 
sidered a random effect. 


6.4.4 The effects due to time may bé caused by 
environmental differences, such as changes in room 
temperature, humidity, etc. Standardization of en- 
vironmental conditions should be attempted to mini- 
mize these effects. 


6.4.5 The effect of skill or fatigue of an operator may 
be considered to be the interaction of operator and 
time. The performance of a set of equipment may be 
different at the time of the start of its use and after 
using it for many hours: this is-an example of inter- 
action of equipment and time. When the population 
of operators. is small in number and the population of 
sets of equipment even smaller, effects caused by 
these factors may be evaluated as fixed (not random) 
effects. 


6.4.6 The procedures given in ISO 5725-2 are -de- 
veloped assuming that the distribution of. laboratory 
components of bias is approximately normal, but -in 
practice they work for most distributions provided that 
called the “between-laboratory variance”, expressed 
as 


Var(B) = of ++) 


However, it will also include effects of changes of 
operator, equipment, time and environment. From a 
Precision experiment using different operators, 
measurement times, environments, etc., in a nested 
design, intermediate precision variances can be cal- 
culated. Var(B) is considered to be composed of in- 
dependent contributions of laboratory, operator, day 
of experiment, environment, etc. 


Var(B) = Var(By) + Var(Byy) + Var(By)) + 


- 6) 
The variances are denoted by 
Var (By) = afo) 
Var(Bq)) = of) ‘ 
Var(Bi2)) = ofa), etc. cp) 


Var(B) is estimated in practical terms as s? and similar 
intermediate precision estimates may be cbtained 
fron suitably designed experiments 


ISO 5725-3:1994| 


6.5 Error term, ¢ 


6.5.1 This term represents a random error occurrin] 
in every test result and the procedures giv 
throughout this part of ISO 5725 were developed a 
suming that the distribution of this error variable’ 
approximately normal, but in practice they work {i 
most distributions provided that they are unimodal 


6.5.2 Within a single laboratory, its variance is call 
the within4aboratory variance and is expressed as 


J is 


6.5.3. It may be expected that ow will have different. 
values in different laboratories due to differences such, 
as in the skills of the operators, but in this Part of: 
'SO 5725 it is assumed that, for a properly standard, 
ized measurement method, such differences be: 
tween laboratories should be small and that it is 
justifiable to establish a common value of withiny 
laboratory variance for all the laboratories using the 


Var(e) = oy 


. Measurement method. This common value, which is, 


estimated by the mean of the within-laboratory vari- 
ances, is called the “repeatability variance” and is 
designated by 


o; = Var(e) 2 sims) 


~ 


This mean value is taken over all the laboratories tak- 
ing part in the accuracy experiment which remain af- 
ter outliers have been excluded. 


7 Choice of measurement conditions 


7.1 In applying a measurement method, many 
measurement conditions are conceivable within a 
laboratory, as follows: 


a) repeatability conditions (four factors constant); 


b) several intermediate precision conditions with one 
factor different; 


c) several intermediate precision conditions with two 
factors different; 


d) several intermediate precision conditions with 
three factors different; 


) intermediate precision conditicns with four factors 
different. 


In the standard for a Measuremer > sre-thod, it is not 
necessary (or even feasible) to «: possible pre-> 
5 


i 


ision measures, although the repeatability standard 

tio should always be specified. As regards’ in- 
‘termediate precision measures, common commercial 
practice should indicate the conditions nomnally en- 
countered, and it should be sufficient to specify only 
the one suitable intermediate precision measure, to- 
gether with the detailed stipulation of the specific 
measurement conditions associated with it. The 
measurement condition factor(s) to be changed 
should be carefully defined; in particular, for time- 
different intermediate precision, a practical mean time 
interval between successive measurements should 
be specified. 


7.2. It is assumed that a standardized measurement 
method will be biased as little as possible, and that 
the bias inherent in the. method itself should have 
been dealt with by. technical means. This part of 
ISO 5725, therefore, deals only with the bias coming 
from the measurement conditions. 


7.3 \A change in the factors of the: measurement 
conditions (time, calibration, operator and equipment) 
from repeatability conditions (i.e. from state 1 to 2 of 
table 1) will increase the variability of test results: 
However, the expectation of the meéan of a number 
of test results will be less biased than under repeat- 
ability conditions. The increase in the standard devi- 
ation for the intermediate precision conditions may be 
overcome by not relying on a single test result but by 
using the mean of several test results as the final 
quoted result. 


7.4 Practical considerations in most laboratories, 
such as the desired precision (standard deviation) of 
the final quoted result and the cost of performing the 
measurements, will govern the number of factors and 
the choice of the factor(s) whose changes can be 
studied _in the standardization of the measurement 
method. 


8 Within-laboratory study and analysis 
of intermediate precision measures 


8.1 Simplest approach 


The simplest method of estimating an intermediate 
Precision standard deviation within one laboratory 
Consists of taking one sample (or. for destructive 
testing, one set of presumably identical samples) and 
Performing a series of nm measurements with a change 


ab ©1SO 


of factor(s) between each measurement. It is rec- 
ommended.that n should be at least 15. This may not 
be satisfactory for the laboratory, and this method of 
estimating intermediate precision: measures within a 
laboratory cannot be regarded as efficient when 
compared with other procedures. The analysis is 
simple, however, and it can be useful for studying 
time-different intermediate precision by making suc- 
cessive measurements on the same sample on’ suc- 
cessive days, or for studying the effects of calibration | 


“between measurements. 


A graph of (y,— ¥) versus the measurement number 
k, where y, is the kK" test result of n replicate test re- 
sults and y is the mean of the 1 replicate test results, 
is recommended to identify potential outliers. A more 
formal test of outliers consists of the application of 
Grubbs' test as given in. subclause 7.3.4 of 
ISO 5725-2:1994. 


* The estimate of the intermediate precision standard 


deviation with M factor(s) different is given by 


k= 


Where symbols denoting the intermediate precision 
conditions should appear inside the parentheses. 


8.2 An alternative method 


8.2.1 An alternative method considers 1 groups of 
measurements, each comprising n replicate test re- 
sults. For example, within one laboratory, a set of t 
materials could each be measured, then the inter- 
médiate precision factor(s) could be altered and the r 
materials remeasured, the procedure being repeated 
until there are n test results on each of the ¢ materials. 
Each group of n test results shall be obtained on one 
identical sample (or'set of presumed identical samples 
in the case of destructive testing), but it is not es- 
sential that the materials be identical. It is only re- 
quired that the ¢ materials all belong to the interval of 
test levels within which one value of the intermediate 
precision standard deviation with M factor(s) different 
can be considered to apply. It is recommended that 
the value of t(n — 1) should be at least 15 


EXAMPLE 


One operator performs a single measurement on 
each of the _t materials, then this is repeated py a 
second operator, and possibly by a third operators, and 
so on, allowing an estimate of $\(0) to be cal 


8.2.2 A graph of (y, — y) versus the material num! er 
J, Where y, is the k" test result on the ;" material'and 
J; is the average of the n results on the J material, is 
recommended to identify potential outliers. A more 
formal test of outliers consists of the application of 
Grubbs' test as given in subclause 7.3.4 of 
ISO 5725-2:1994 either for each group separately or 
for all tn test results combined. 


The estimate of the intermediate precision standard 
deviation with M factor(s) different, 5), is then given 
by - 


For n= 2,(i,e. two test results:on each material), the 
formula simplifies to 


P cece) 


83° Effect of the measurement conditions on 
the final quoted result 


8.3.1 The expectation of ¥ is different between one 
combination and another of time, calibration, operator 
and'equipment, even when only one.of the four fac- 
tors changes. This is a limitation on the usefulness of 
mean values. In chemical analysis or physical testing, 
¥ is reported as the final quoted result. In trading raw 
materials, this final quoted result is often used for 
quality evaluation of the raw materials and affects the 
price of the product to a considerable extent. 


EXAMPLE 


In the international trading of coal, the size of the 
consignment can often exceed 70 000 t, and the ash 
content is determined finally on a test portion of only 
1g. In a contract stipulating that each difference of* 
1 % in ash content corresponds to USD 1,5 per tonne 
of coal, a difference of 1 mg in the weighing of ash 
by a chemical balance corresponds to 0,1 % in ash 
content, or USD 0,15 per tonne, which for such a 
consignment amounts to a difference in proceeds of 
USD 10 500 (from 0,1 x 1,5 x 70 000). 


8.3.2 Consequently, the final quoted result of 
chemical analysis or physical testing should be suf- 
ficiently precise, higtily reliable and, especially, unt 
versal and_reproducible. A final quoted result which 


can be guaranteed only under conditions of a specif 
operator, equipment or time may not be good enoug : 
for commercial considerations. 


9 Interlaboratory study and analysis of | 
intermediate precision measures 


9.1 Underlying assumptions 


Estimation of intermediate measures of precision] 
from interlaboratory studies relies on the assumptio 
that the effect of a particular factor is the same across| q 
all laboratories, so that, for example, changing oper: 
ators in one laboratory has the same effect as chang 
ing operators in another laboratory, or that variation] 
due to time is the same across all laboratories. If thist 
assumption is violated, then the concept of inter} 
mediate measures of precision does not make sensef 
nor do the techniques proposed in the subsequenth 
sections to estimate these intermediate measures off 
precision. Careful attention to outliers (not necessarilyf 
deletion of outliers) must be paid as this will help ing 
detecting departure from the assumptions necessaryf 
to pool information from all laboratories. One powerfulf 
technique to detect potential outliers is to depict the} 
measurements graphically as a function of the various}, 
levels of the factors or the various laboratories in- 
cluded in the study. 


9.2. Simplest approach 


\f material at ¢ levels is sent to Pp laboratories whot 
each perform measurements on each of the q levels! 
with a change of intermediate precision factor(s) be-| 
tween each of the n measurements, then the analysi: 
is by the same method of calculation as explained in’ 
1SO 5725-2, except that an intermediate precision 
standard deviation is estimated instead of the repeat- 
ability standard deviation. 


9.3 Nested experiments 


A further way of estimating intermediate precision | 
measures is to conduct more sophisticated exper- | 
iments. These can be fully-nested or staggered- | 
nested experiments (for definitions of these terms, | 
see ISO 3534-3). The advantage of employing a; 
nested experimental design is tha: «1 1s possible, at f 
one time and in one interlaboratory experiment, to; 
estimate ‘not only repeatability anu reproducibility 
standard deviations but also one or re intermediate | 
precision standard deviations. Ths are, however, + 


wee 


ame 


ertain caveats which must be Considered, as 
plained in 9.8. 


“9.4 Fully-nested experiment 


A schematic layout of the fully-nested experiment at 
a particular level of the test is given in figure 1. 


By carrying out the three-factor fully-nested exper- 

_iment_collaboratively in several laboratories, one in- 
termediate precision measure can be obtained at the 
same time ‘as the repeatability and reproducibility 
standard deviations, 1.8.0), q) and o, can be esti- 
mated. Likewise the fourtactor fully-nested exper- 
iment can be used to obtain two intermediate 
precision measures, i.e. 0), (1), 9) and o, can be 
estimated. 


FACTOR 


0 (laboratory) 


" OlSOh 


ipts i, j and k suffixed to the data y in 
er i the shirGerfactor fully-nested experiment 
ent, for example, a laboratory, a day of exper- 
-iment and a replication under repeatability conditions, 
“respectively. - 


The subscripts i, j, k and /-.suffixed to the data y in 
figure 1b) for the four-factor fully-nested experiment 
represent,-for example, a laboratory, a day of exper- 
iment, an Opérator and a-replication under repeatability 
conditions, respectively. 

Analysis of the results of an n-factor fully-nested ex- 
perirnent is carried out by the statistical technique 


“analysis of variance” (ANOVA). separately: for each 
level_of the test, and is described in detail in 


annex B. 


1 jo 
2iresidudt) “k--= 
Sipe Yin Yin Yin Yin 
a} Three-factor fully-nested experiment 
FACTOR 
0 (taboratory) foe | 
1 
: | 
3 (residual) ¢ --- | ] 
Vint yim Jive Yi Vin Yan Sine Vir Vi222 
b) Four-factor fully-nested experiment 
Figure 1 — Schematic layouts for three-factor and four-factor fully-nested experiments 
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9.5 Staggered-nested experiment = 


A schematic layout of the staggered-nested exper- 
iment at a particular level of the test-is given in 
figure 2. 


FACTOR 
0 (Laboratory) 
4 


2 


3(residuat) ~ j-—- 


vi ee du 


Figure 2 — Schematic layout of a four-factor 
staggered-nested experiment 


The three-factor staggered-nested experiment re- 
quires each laboratory i to obtain three test results. 
Test results y,; andy shall’be obtained under re- 
peatability conditions, and y,, under intermediate pre- 
cision _ conditions . with: M - factor(s) different 
(M = 1,2 or 3), for example under time-different in- 
termediate precision conditions (by obtaining yg ona 
different day from that'on which y,, and yj were ob- 
tained). 


In a four-factor staggered-nested experiment, y;4 shall 
be obtained under intermediate precision conditions 
with one more factor different, for example, under 
[time + operator}-different intermediate precision 
conditions by changing the day and the operator. 


Again, analysis of the results of an rfactor 
staggered-nested experimient is carried out by the 
Statistical technique “analysis of variance” (ANOVA) 
separately for each level of the test, and is described 
in detail in annex C. 


9.6 Allocation of factors in a nested 
experimental design 


The allocation of the factors ina nested experimental 
design is arranged so that the factors affected most 
by systematic effects should be in: the highest ranks 
(0, 1, ...), and those affected most by random effects 


~~ should be in the lowest ranks, the lowest factor bein 


ISO 5725-3:1994(6 


considered as a residual variation. For example, in-ag.. 
four-factor design such as illustrated in figure 1b andj 

figure 2, factor 0 could be the laboratory, factor 1 the 
operator, factor 2 the day on which the measurement 
is carried out, and factor 3 the replication. This may 
not seem important in the case of the fully-nested 
experiment due to its symmetry. 


9.7 Comparison of the nested design with 
the procedure given in ISO 5725-2 


The procedure given in ISO 5725-2, because the J 
analysis is carried out separately for each level of the.| 
test (material), is, in fact, a two-factor fully-nested ex- 4 
perimental design and produces two standard devi- 4 
ations, the repeatability and reproducibility standard | 
deviations. Factor.0 is the laboratory and factor 1 the | 
replication. If this design were increased by one fac- 3 
tor, by ‘having two operators in each laboratory each” 
obtaining: two test results under tepeatability con? 
ditions, then, in addition to the repeatability. and 
reproducibility standard deviations, one could deter- 
mine the ‘operator-different intermediate precision 
‘standard deviation. Alternatively, if each laboratory + 
used only one operator but repeated the experiment..:| 
on another day, the time-different intermediate pre-f 
cision standard deviation would be determined by this jj 
three-factor fully-nested experiment. The addition of { 
a further factor to the experiment, by each laboratory | 
having’ “two operators each carrying out two 
measurements and the whole experiment being re- 4 
peated the next day,’ would allow determination of the 
repeatability, reproducibility, operator-different, time- 
different, and [time + operator]-different standard 
deviations. 


9.8 Comparison of fully-nested and 
staggered-nested experimental designs 


An r-factor fully-nested experiment requires 2"~' test 
fesults from each laboratory, which can be an ex- 
cessive requirement on the laboratories. This is the 
main argument for the staggered-nested experimental 
design. This design requires less test results to pro- 
duce the same number of standard deviations, al- 
though the analysis is slightly more complex and there | 
is a larger uncertainty in the estimates of the standard 

deviations due to the smaller number of test results, 


Bo 


Bay. By), etc. . 


Gc, eo 
‘Corie C'esite Cert 
CD, 

CRp 
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Intercept in the relationship 
s=a+bm 


Factor -used to calculate the uncer- 
tainty of an estimate 


Slope in the relationship 


s=atbm 


Component in a test result rep- 
resenting the deviation ofa labora- 
tory from the general average 
(laboratory component of bias) 


Component of B representing all 
factors that do not change in inter- 
mediate precision conditions 


Components of B representing fac-. 


tors that vary in intermediate pre- 
cision conditions 


Intercept in the relationship 
Igs=c+digm 

Test statistics 

Critical values for statistical tests 

Critical difference for probability P 

Critical range for probability P 

Slope in the relationship 
Igs=c+digm 


Component in a test result rep- 
resenting the random error occur- 
ting in every test result 


Critical range factor 


p-quantile of the F-distribution with 
v, and vy degrees of freedom 


Grubbs’ test statistic 


Mandel's between-laboratory con- 
sistency test statistic 


Annex A 
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Symbols and abbreviations used in ISO 5725 


_Mandel's within-laboratory consistency test sta- 


~~ tistic 


LCL Lower control limit (either action limit or warning 


m 


M 


N 


= 


u 


vv 


. 


R 


RM 


o> 


t 


limit) 
General mean of the test property; level 


Number of factors considered in intermediate 
precision conditions 


Number of iterations F 


Number of test’ results’ obtainéd’in one labora- 
tory at one level (i.e. per cell) 


Number of laboratories participating in’ the inter- 
laboratory experiment : 


Probability 


Number of levels of the test property in the 
interlaboratory experiment 


Repeatability limit 
Reproducibility limit 


Reference material 

Estimate of a standard deviation 
Predicted standard deviation 
Total or sum of some expression 


Number of test objects or groups 


UCL Upper control limit (either action limit or warning 


Ww 


» 


< 


limit) 


Weighting factor used in calculating a weighted 
regression 


Range of a set of test results 
Datum‘used for Grubbs” test 


Test result 


~ Arithmetic mean of test results 


sel 


Grand mean of test results 


<0 


a Significance level 
B Type Il error probability 


y Ratio of the reproducibility standard deviation to 
the repeatability standard deviation (ap/a,) 


4 Laboratory bias 

4 Estimate of A 

56 Bias of the Measurement method 
é Estimate of 6: 


Detectable difference between two laboratory 
biases or the biases of two measurement 
methods 


“ True value or accepted reference value.of a test 
property 


v Number of degrees of freedom 


oe Detectable ratio between the repeatability stan- 
dard deviations of method’B and method A 


g True value of a’ standard deviation 


Tt Component in a test result representing the 
variation due'to time since last calibration 


o Detectable ratio between the square roots of 
the between-laboratory mean squares of 
method B and method A 


£() P-quantile of the -distribution with v degrees 
of freedom 


(1), (2),.(3)... 


ymbols used as subscripts 


Calibration-different 
Equipment-different 
Identifier for a particular laboratory 


Identifier for intermediate measures of 
Precision; in brackets, identification of 
the type of intermediate situation 


Identifier for 
(ISO 5725-2). : 
Identifier for a group of tests or for a | 
factor (ISO 5725-3) 4 


a particular. level ; 


Identifier for a particular test result in a 
laboratory i at level yi 


Between-laboratory (interlaboratory) 
Identifier for detectable bias 
Between-test-sample 
Operator-different 

Probability 

Repeatability 

Reproducibility 

Time-different 

Within-laboratory (intrataboratory) 


For'test results, numbering in the order 
of obtaining them 


For test results, numbering in the order | 
of increasing magnitude | 
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Annex B 
(normative) 


Analysis of variance for fully-nested experiments 


1e analysis of variance described in this annex has to be carriediout separately for each level of the test included 
in the interlaboratory experiment. For simplicity, a subscript indicating the level of the test has not been suffixed 
‘to the data. It should be noted that the subscript j is used in this part of ISO 5725 for factor 1 (factor 0 being the 
laboratory), while in the other Parts of ISO 5725 it is used for the level of the test. 


|. The methods described in subclause 7.3 of ISO 5725-2:1994.should be applied to check the data for consistency 
and outliers. With the designs described in this annex, the exact analysis of the data is very complicated when 
some of the test results from a laboratory are missing. If it is decided that some of the test results from’a. lab- 
» oratory are( agglers)or ‘gutliers, and should be excluded from the analysis, then itis recommended that all the 
” data from that laboratory (af thé level affected) should-be excluded from-the analysis. or 


B.1 Three-factor fully-nested experiment 
The data obtained in the experiment are denoted by yz, and the mean values and-ranges are as follows: 


z4) 


W=F Own +90) i= + On + Fa) 


Wa) = Din — Yial Wia) = Din ~ Yial 


where p is the number of laboratories which have participated in the interlaboratory experiment 


The total sum of squares, SST, can be subdivided as 


sst= > bi -3)? = 880+ $81 + $Se 
ioj ok 
where 
z y : N 
s50= 3) 6-5 4S 6-1? 4D oy mG? j 
roy Sk 7 - 
S81 = 37 7 6-9)? = 2. 6, - W)? = Dowdy 
ij ok a, ; 
sse= 3) 0-H? =F Dvd 
7 TS ar 


Since the degrees of freedom for the sums of squares SSO, SS1 and SSe are Pp 1, p and 2p, respectively, the 
ANOVA table is composed as shown in tabie 8 i 
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Table B.1 — ANOVA table for'a three-factor fully-nested experiment 


| soe | | ese | saa ci 


0 MSO = SSO/(p—1) | o? + 20% + doz) 
1 MS1 = SS1/p 
Residual MSe = SSe/(2p) 


2 cig Zt 
o, + 2a, 
a 


c+ 


The unbiased estimates so) sf and s? of oy. of and 02, respectively, 


can be obtained from the mean’‘squares 
MSO, MS1 and MSe as : 


| si =} (so - Ms1) 
\ 
I si = (MS1— Mse) | 
5? = MSe 


The estimates of the repeatability variance, one-factor-different intermediate. precision variance and reproducibility 
variance are, respectively, as follows: 


2 


os 
Sate 2 255.2 
! Sy = + 5) £ } 
i a = + 5h) + shy J 
i 
| 
' B.2 Four-factor fully-nested experiment 
k The data obtained in the experiment are-denoted by Yix ANd Mean values and ranges are as follows: 
> 1 
Jk Over + Yyx2) Winn) = Dyer — Yigal 
ee - eee f ‘ 
W=z Oin + Yin) Wy) = Bin — Fil f 


Wea) = Wir — Fial 


where p is the number of laboratories which have Participated in the interlaboratory experiment. 


The total sum of squares, SST, can be subdivided as follows: i 
sst=F OH 
t i k Uy 
; {if 
where i 


a x Dre “y= 89° (5)? — Bp)? 


y)* = SSO + SS1 + SS24 SSe 


"$81 = 7)? = § i 
LEE Tow ay Deiat ayy 
82°F DD Dow -2E DY Now = I Dn 
i j ij k i, J 
SEE Tew FOE Te 
i i t k 7 


me Since the degrees of freedom for the sums of squares SSO, SS1, SS2. and SSe are p — 1, p, 2p and-4p, respectively, 
the ANOVA table is composed as shown in table B.2. ' 


Table B.2 — ANOVA table for a four-factor fully-nested experiment 


MSO = SSO/(p'+1) | of + 20fy:+ 4a) +80) 


MS1 = SS1/p oF +.20 5 + 40), 
MS2 = SS2/(2p) | 0? 4: 205 
Residual 4p MSe = SSo/(4p) oe 


8p —1 


The unbiased estimates Sho. sty. 2) and s? of oto. or, oy and o, respectively, can be obtained from the. mean 
squares MSO, MS1, MS2 and MSe as follows: 


Total 


sky -} (MSO-MS1) .* 


sf =} (MS2 ~ Ms) | © 


ty =} (MS1 ~ MSe) 


5? = MSe 


The estimates of the repeatability variance, one-factor-different intermediate precision variance, two-factors dif- 
ferent intermediate precision variance and reproducibility variance are, respectively, as follows: 


Ss 
2 2 2 
Sia) =5, A S(2) 
2 2 a 2 
Ha) = 5 + Say + 5 NN 


2 2 2 2 
Sp = s? So S(2) + S11) + Sio) 
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Since _the degrees of freedom fer ine sums of squares SSO, SS1_and SSe are P 


= Annex Cc { 
(normative) i 


Analysis of variance for staggered-nested experiments 


The analysis of variance described in this annex has to be carried out separately for each level of the test include 
__in the interlaboratory experiment. For simplicity, a subscript indicating the level of the test has not been suffixg 


to the data. It should be noted that the: subscript is used in this part of'ISO 5725 for the replications within thy 
est. - 


laboratory, while in the other Parts of ISO 5725 it is used for the level of the t 


The methods described in subclause 7.3 of ISO 5725-2:1994 should 
ind outliers. With the designs described in this annex, the exact an: 
some of the test results from a laboratory are missing. If it is decider 


alysis, then it-is recommended ‘that all tl 
data from that laboratory (at the level affected) should be excluded: from the ge by 


C.1 Three-factor staggered-nested experiment 


The data obtained in the experiment within laboratory i are denoted by vO 


=, 2, 3), and the mean values.a 
ranges are as follows: 


= 1 
Jia) = On + Ya) wa) = Dir — Yl 


A 
Jia) = 4 On + Ye + Ya) Wi2) = Biqay — al f | 


where p is the number of laboratories which have participated in the interlaboratory experiment. 


The total sum of squares, SST, can be subdivided as follows: 
sst= >" > 6-3)? = 80 + $51 + Sse 
Cae) 
where 


= a | 
SSO = 3 Gig)? — 3p(y)? P al 
2 2 
SS1 = > > viey 


1 2 
SSe = > dvi) 


1, p and p, respectively, the 
ANOVA table is composed as show in tableC.1, 


factor staggered-nested experiment 


Expected mean square 
2, 5 


> 2 
o +3 (1) + 30%) 


of +A, 


SS1jp 3 


Residual 


SSe/p 


Total 


The unbiased estimates 5. Say and s? of oo. o() and o7, respectively, can be obtained from the mean squares 
MSO, MS1 and MSe as follows: 


Beals BeBe. ole: 

S(o) = = MSO ~ 5-MS1 + 1 MSe. , F Y 
2.3 me 

Sy =f MS1 ~ 3 MSe ' 

5? = MSe 


The estimates of the repeatability variance, one-factor-different intermediate precision variance and reproducibility 
variance are, respectively, as follows: ; 


2 
Sy 


2 2 2 
Sy = 5 + Sr) . ) 


72 52 2 
Sp = S, + Say + 5(0) 


C.2 Four-factor staggered-nested experiment 


The data obtained in the experiment within laboratory i are denoted by yy (j= 1, 2, 3, 4), and the mean values and 
ranges are as follows: = 


1 fesard 
= On +2) way = Dia — Yl : 
Jia) = + (Yin + Yi2 + Yea) Wi@2) = Dia) — Yal Gy 
1 - 
= (in + Via + Ya + Ya) Wiay = Dire) — Yial 


} iim 


where p is the number of laboratories which have participated in the interlaboratory experiment 


The ANOVA tabie is composed as shown in table C.2. 
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Table C.2 ei ANOVA table for a four-factor staggered-nested experiment 
Sum of squares Degrees of 


420i)" 40)" SSO[(p - 1) P+ Foi) + S02, + 40h 


3 
aoe SS1/p $+ Zot Soi, 
2 5,2 4 
3 Mia SS2jp ot z a) 
Residual towi, SSelp . 
i 


Total LLOy-y 
ai 


C.3 Five-factor 'Staggered-nested experiment 


The data obtained i in the experiment within laboratory i-are denoted by yy; (j=.1, 2,3, 4,5), and the mean values: 
and ranges areas follows: : 


Jon = 2 Dey, + Yi) Way = Da — Jal 

Ji) = + 6m +a +g) nen = Diay — Yel § 
Jia) = t Ou + Yin + Ya + Ya) Wica) = Bia) — Yial 

Jia) = + bn + V2 + Yia + Yia + Ys) Wia) = Via) — isl 


= 4 wm 
3= 5 Diy 
where p is the number of laboratories which have participated in the interlaboratory experiment. 


TI 1@ ANOVA table is composed as shown in tableC.3. 


Table C.3 — ANOVA table for a five-factor staggered-nested experiment 


Sum of squares Mean square Expected mean square 


== = 
5EOua)” — 5p)" SSO/(p ~ 1) Joh, + hob, + Zod, + 50%, 

Ain2 i Vo = 18. 2 Be 

5 Ya) SS1ip ty 3 +50 te eM 


3 
7 Swen SS2ip 


$ Bole Sai 


Residual SSe/p 


Fie 
Total LLOy-y i 
oa 


7 


Residual 


> 1 
Vita) = 


Jig) = 


Jia) = + Oi + Ya) 

Jia) = 4 (in + Ya + Ya) 

Jia) = + On + 2 + Ya + Ya) 
Oi + ¥2 + Via + Yin + Ys) 


in + Yi + Ya + Ya + Ys + is) 


The ANOVA table is composed as shown in table C.4. 


>.4 Six-factor staggered-nested experiment 


The data obtained in the experiment within laboratory i are denoted by y; (j = 1, 2, 3, 4, 5, 6), and the mean values 
and ranges are as follows: 


way = ba — Yel 


Wi 2) = Dia) — Yal 


Wig) = Bicay— ial 


wa) = Vira) — Yisl 


Ws) = Dic) — Yiel 


: where p is the number of laboratories which have participated in the interlaboratory.experiment.. « 


Table C.4 — ANOVA table for a six-factor staggered-nested experiment 


826i)" - 690" 
5 

S Iwi) 

4 

= Iwo 

3 

a Dwi, 


2 Ewiy 


$ Swi 


SSO/(p- 1) 
SS1)p 
SS2/p 
SS3/p 
SS4/p 
SSelp 


2, te 2 2 13.2 2 
A, + May + 2oGy + 3a + —Z~ 01) + Boo 
2,16 2 6 2 72 5 2 
or +45 Mt Oates Fat OM 


as 2 8 2 
+59 %@t 5 ew 
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(intormative) 


Examples of the statistical analysis of intermediate precision experiments | 


D.1_ Example 1— Obtaining the [time + 
Operator]-different intermediate Precision 
standard deviation, 510), Within a specific 
laboratory at a Particular level of the test 


D.1.1 Background 


a) Measurement method: Determination of the 
a) carbon content in steel by vacuum emission 


s by mass. 


b) Source: Routine report of a steel works in Nov- 
ember 1984. 


c) Experimental design: in a specific laboratory, a 
randomly selected sample out of the materials 
analysed on one day was analysed again on the 
next day by a different analyst. In a month 29 pairs 
of such data were obtained (see table D.1). 


Table D.1.— Original data — 


S| rometry with test results expressed as per 


D.1.2 Analysis 4 
The data Yn Ya and w; = ly, Yl are shown in 
tableD.1. The analysis follows the Procedure given in 
8.2. 


A plot of the data [deviations from the mean of the 
measurements on both days vn ~ J) versus the 
sample number /] is shown in figure D.1. This plot and ' 
the application of Cochran's test indicate that the F 
fanges for samples with numbers 20 and 24- are I 
outliers. There is a large discrepancy between the 
daily measurements on these samples which is most 
likely due to errors in recording the data. The values 
for these two samples were removed from the com-. 
Putation of the [time + Operator]-different intermedi- 
ate precision. standard deviation, Sito), “Which is 
calculated accordirig to equation (12) as 


= 2,87 x 1073 Z 


Carbon content, % {m/m) 


19 


g 
= 
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Figure D.1 — Carbon content in steel — Deviations from the mean of the measurements on both days 
versus the sample number 


D.2 Example 2 — Obtaining the 
time-different intermediate precision 
standard deviation by interlaboratory 
experiment 


D.2.1 Background 


a) Measurement method: Deiermination of the 
vanadium content in stee! by the atomic absorp- 
tion spectrometric metrod described in the in- 
structions for the expenment. Test results are 
expressed as percentages by mass. 


b) Source: !SO/TC17, Steel/SC 1, Methods of de- 


termination of chemical composition. Experiment 
carried out in May 1985. 


c) Experimental design: A three-factor staggered- 


iment. All measurements in any laboratory were — 


nested experiment was carried out with 20 lab- 
oratories each reporting two test results obtained 
under repeatability conditions on one day, fol 
lowed by one further test result on the next day 
at each of the six levels included in the exper- 


carried out by one operator, 
_ measurement equipment. 


using the same 


D.2.2 ~ Analysis ~ ee ° atory. There is a large discrepancy between the t 
cart . result for day 2 and the mean value for day 1, we 
is very large compared with the test results for 

F 7" other laboratories. This laboratory was removed from 
The analysis of variance is presented for only one of the calculations of the precision measures. e 
the levels, i.e. level 1. 


The data for ali six levels are given in table D.2. 


A plot of the data (test results for day 1 and day 2 In accordance with C.1 of annex C, wia, Wia) and 
versus laboratory number ji). is shown in figure D.2. Jia) Were computed and the results are shown in ta. 
This plot indicates that laboratory 20 is an outlier lab- ble D.3. i 


150 T F 
re O Oay 4, first test result 
2 + Day 1, second test result 
sO * Day 2 #8 
s 
§ 
ae 
4 = 30 + “ | = | 
= 
§ . 
€ 
2 
3 
& 
= 120 } ~~ ot | 
i + * 
| | 
* 
; 110 a jo —=4 
o 
Oo ay ca * 
+ + 
100 & —__* +B} —* 
a oo a 
+ * 
a ® + 
Q * + 
sof Oy, a —~+— 2 
* 
80 
yoLuiito 14 a bit 4 
4 4 8 12 6 20 


Laboratory number, ¢ -—-—— 


Figure D.2 — Vanadium content in steel — Test results for day 1 and 2 at level 1 versus laboratory number 


21 


oo 
Be 
8 


sith 


i 


6 9€0'0 | 8 0700 | 0 ZE0'0 | 0010'0 | 0 hL0'0 | 0 r10'0 02 


eizio vOl'O | 60L'0 } O1L'0 | 9 9E0'0 | S ZE0'0 | E 8E0'0 | » OL0'0 | 9 G00’ | 8 E000 6L 
£190 | ¥19'0 |-S1S'0 |: 212'0, }'81z'0 v22'0 £010 | vOL'O | €0L'O | » ZE0’O | 0 BE0'O | Z BE0'O | B LLO'O | SOt0'0 | EaL0'0 BL 
vis'o |S1S'0 | Lts’0 |’ 6020 olz'o 12’. | vOL'O | 80L'O | ZOL'O | € LE0'0 | 2 8E0'0 | 6 BEO'O | Z 110'0 | ZOL0'0 | SQLO'O a 
L€S'0 | 21S'0 | 6tg’0 | 8120 |:Ztz'0 |'912'0.| vOL'O | S0L'O | SO1'0 | 4 GEO'O | ¢ LE0'0 | E ZEO'O | $'600'0 | 00100 | 8 6000 Tt 


sis‘o |ots’o |ous’o | Lizio, 4ot'0 | 01'0 | 6o1'0 | z 6e0'o | ¢ ce0'0 | 1 Be0'0 | z g00'0 | 1 600° | 6 E000 st 
zzs'o | 8zs’o | ozs’0-|-z1z'e-] etz'o-|-81z'0 | o11'0 | 901'0 | vol'o | 6 ee0'o | » ze0'o | v ce0'0 | 010’ | 9 600'0 | 9 600'0 vt 
g0s‘o |ozs'o | o1s’0 |: siz‘o’ |'2zz’0 | z12'0 | e01'0.| vor’ | e0u‘0 | $ zeo'o | s ceo’ | ¢ ce0'o | $ 600'0 | $ 600'0 | 0 010'0 el 
o1s’o |ezs‘0 | Gos‘0 | 01z'0.|s1z’0 | Bozo | sou’o | 801’0 | to1'0 | 0 ee0'o | 0 6e0'0 | 0 G00 | 2 600'0'| $s 110'0 | 6 O10’ zu 
5 vis'o jais'o Jeis’o | viz'o | 1iz'0 |eiz'o | zov'o | zov‘o | zor'o | s zeo’o | 0 se0'0 | 0 Be0'0 | 0 600'0 | 00100 | oo10'0 ub 
at szs‘o |ozs’o | ozs‘o | szz’o |0zz’0 | o1z’0 | soi’o j ott’ | sot‘o | ogeo'o | sze0'0 | 0 ceo‘ | 2 600'0 | 8 L100 | z o10'0 ob 
> sis‘o |sis‘0 | 6os‘o | eiz‘o |soz'0 | t1z’0 | sov’o | 901'0 | vo1'o | Z 9¢0°0 | 0 ceo’ | ¢ ge0'0 | o'o10'0 | v 6000 | v o10'0 6 
‘al {1s'0 "| e6y'0 | zos‘o | o1z‘o | s61’0 | e61'0 | gol’ | 201’ | e010 | 6 zeo'o | 9 9e0'0 | 6 cev'0 | 6 6000 | » 6000 | 9 e00'0 a 
3 gzs'o |eis'0 | tzs’0 | 912'0 |siz'o |siz’o | sor'o | so1'0 | coro |  se0'0 | 0 ge0'0 | 9 ze0'0 | 1 o10'0 | 6 6000 | 8 600'0 L 
ie e1s‘o | zes'o |9zs'o | izz'o }ovz‘o | zez’o | go1'o | g01'0 | got'o | z Le0'0 | @ g€0'0 | 8 9¢0'0 | ¥ G00'0 | » 600'0 | 6 a00'0 9 
ig zis‘o | o0s'o | sev’o | soz‘o j.01z’o | o1z’o | o11'0 | eor'o | eo1'o | 0 ze0'o | 0 Leo’ | 0 s€0'0 | 00100 | cot0'0 | oo10'0 $ 
2 gis'o |eis’o | eis‘o | toz’o-|zzz'o | viz’0 | vo1'o | 901'0 | Got’ | z ec0'0 | 1 9€0°0 | » ze0'0 | z L00'0 | € 8000 | 0 e00'0 ® 
2 v0s'o | pis'o }oos’o | siz’o |siz‘o | e1z'0.| zo1’o Jott’ | aor'0 | 0 ze0'o | 0 ge0'0 | 0 6e0'0 | ¥ 600'0 | 0 600'0 | s 600'0 € 
| 06£0'0 | 0 1p0'0 | 0 t¥0'0 | 0 600'0 | 0 0100 | 0 o10'0 z 
a s eeo'o | 8 8co’o | z e€0'o | 8 600'0 | z 010'0 | 1 so0'o 
2 ™% % % "%K " 
2 4 aka. 4 
- 1 Aeg zAeq 1 Aeq 1 Aeg Ei! zAeg 1 Aeg zAeq z Aeg L Aeg on 


AMoyes0qe7 


(% S£'0) 9 2407 (% S'0) $ 19007 (% 2'0),¥ 19007 (% 10) € 19009 (% p0'0) 2 19A07 (% 10’) b 19A07 


1994(E) 


25-3 


») = 0,009 798'25 


: Table D.3 — Values of Wi » Wii) and yj, 


Laboratory 
No. i) (2) Jia 
i 


From these values, the sums of Squares SSO, SS1 and : 
SSe are obtained, and the ANOVA table is prepared ° 


1 0,000 15 0,009 700 as shown in table D.4. 
2 0,001 00 0,009 667 
3 0,000 15 0,009 300 The unbiased estimates of variances between labora- 
4 0,000 45 0,008 000 tories Soy between days within a laboratory Stay and 
S 9,000 00 | 0,010 000 the estimated repeatability variance 52 are obtained 
6 0,000 25 0,009 233- as aca 
7 0,000 25 0,009 933 
8 0,000 40 0,009 633 50) = 0,278 x 1075 
9 0,000 10 0,009 933 QO 
0,001 55 0,010 733 Fi -6 S 
0,00100 | 0,009 667 A= OPT IG J 
0,001 50 0,010 700 2 = 
0,000 25 | 0.009667 5 = 0,145 x.10-° 
0,000 40 0,009 733 
0,001 30 0,009 067 a : 
0,000 40 0,009 767 The reproducibility standard . deviation Sp, time- 
0,000 85 0,010 633 different intermediate precision ‘standard deviation 
0,001 40 0,010 867 Si, and repeatability standard deviation 5, are ob- 


0,000 70 0,009 933 tained as 


a a * fi} 2 2 22 -3 
The sums of squares of Wirrys Wy) and Fi) and the SR V 5 +51) + 5(q) = 0,801 x 10 


mean value y are computed as 


(a) -3 a 
= V8? +52) =0,603 x 10 / 
> wit = 5,52 x 1078 Ay = Vee ey x A 
i 
5,= 5? = 0,381 x 10-3 


The values of these standard deviations for the six 
> Gia)? = 1 832,16 x 10-§ levels of vanadium content are summarized in 
i table D.5 and shown in figure D.3, 


© Swi, = 12,44 x 10-8 
a 


Table D.4 — ANOVA table — Vanadium content 


Expected mean square 
0 (laboratory) 1,342 x 10°® | 6248 | ‘| 
1 (day) 8,29 x 10°& 0,436 x 107° 


Residual 2.76 x 1078 0,145 x 107® 


Total 35,21 x 1076 
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Outlier 
laboratories 


0,381 x 1079 
0,820 x 10? 
1,739 x 107° 
3,524 x 107° 
6,237-x 107° 
9,545 x 107° 


Table D.5 — Values of s,, Siqn_ aNd sp for six levels of vanadium content in steel 


0,603 x 107° 
0,902 x 107° 
2,305 x 107° 
« 4,710 x 1075 
6,436 x 107° 


9,545 x 1079 


0,801 x 107? 
0,954 x 107° 
2,650 x 10°* 
4,826 x 107° 
9,412 x 10°8 
15,962 x 1077 


% (n/m) x 10°?» ——— 
a 


8 


OTT 
a | 
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| | } 
[ 

| 
K Mj 
| ME AAT 

ES alll 


0.004 


Concentration level. % 


Figure D.3 — Vanadium content in steel — Repeatability standard deviation s,, time-different intermediate” 
precision standard deviation Si and reproducibility standard deviation ;, as functions of the concentration 
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level 
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